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METHOD AND ARRANGEMENT FOR INSPECTION OF AN OBJECT 

Cross Reference to Related Application 

This is a continuation-in-part of U.S. Patent Application No. 10/303,380, filed 
November 22, 2002 (which will issue as U.S. Patent No. 6,712,017 on March 30, 2004), 
which is a continuation of International Application No. PCT/SE01/01 182, filed May 
25, 2001, which claims priority from both Swedish Application No. 0001970-3, filed 
May 24, 2000, and U.S. Provisional Application No. 60/207,133, filed May 24, 2000. 

Technical Field of the Invention 

The present invention relates to an inspection system for inspection of an object, 
at least comprising an image-recording unit supported by an inspector, a display unit 
and a storage unit. The invention particularly relates to inspection of ships or the like. 

The State of the Art 

Ships are inspected at close intervals according to law. The inspection typically 
is carried out in a dock or by divers filming the complete entire bottom of the ship. 

At conventional diving inspections, the inspection is usually carried out in the 
sea, since the visibility is much better there than at the harbours. The person to perform 
the inspection goes out to the ship in a separate boat, on which all the equipment is 
brought. At a diving inspection, except for three persons from the diving company, 
representatives of the classification society and the shipping company are present as 
well. 

During the inspection, the diving company also has divers in the water equipped 
with a camera and sound transmission equipment and a person supervising the diver. 
The third person of the diving company monitors a TV screen, together with the 
representatives of the classification society and the shipping company. The images 
from the camera of the divers are shown on the TV-screen and stored on a videotape as 
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well. The persons in front of the TV-screen decide which action is to be performed on 
the ship. At this time, notes are taken on the detected damages and the counting 
mechanism of the video is recorded. 

The diver swims from starboard to the port side, and then moves approximately 
2 meters towards the prow, then swims from port to starboard. This pattern is repeated. 

The diver keeps track of his position relative to the ship by reading a measuring 
tape, which is placed in the middle under the ship before the diver started the 
inspection. The person watching the diver at the TV-screen receives the position of the 
diver from the diver. 

A ship inspection consists of diving work and writing reports for the diving 
company. The diving work itself takes approximately 8-12 hours for a ship of average- 
size. After the diving work is completed a report is prepared. It takes about 8 hours to 
process the videotapes and select frames of the film based on the remarks and writing 
text corresponding to each remark. 

In U.S. 3,776,574, an inspection system for hulls of vessel is described, wherein 
a diver swims backwards and forwards under the ship and films the hull of the vessel. 
For orientation and positioning, the hull of the vessel is marked by painting squares and 
by numbering. At the inspection the areas and their identity numbers are filmed and 
recorded. As described, this system is time consuming by the marking procedure, the 
storing and the recovering of information. Criticised areas must be searched and/or 
registered for manual scanning later on. 

Short Description of the Invention 

The object of the present invention is to provide a system simplifying the 
inspection work, reducing the inspection and the reporting time and facilitating the 
documentation and the search in the documentation. 
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In the system, according to one preferred embodiment of the invention, the 
position of a diver is related to the film and this is displayed on a computer monitor, for 
example. 

Additional advantages of the system are: 
ensured inspection results, 

improved control of the position of the inspector or data gathering entity, 
easier to find specific check points, e.g., valves, etc., 
the documentation of the diver positions, 

easy to study specific parts of the inspected object afterwards by clicking 

on a drawing, 

less documentation work, 

generating different reports directly from a computer, 
appropriate for several applications, e.g., harbour inspections and 
inspections offshore, and inspections of larger objects on shore, and 
the system is built in such a way that it is possible to substitute a diver by 
an ROV (unmanned submarine robot) or any other image recorder 
carrying entity. 

These objects have been solved by the present system which includes a contact 
free positioning unit and storage unit arranged to store at least an image taken of said 
image recording unit in relation to a position given by said positioning unit and/or a 
time index. The system can comprise means for connecting a time and/or position 
index to said position and image and a note. Moreover, the system can comprise means 
for digitally storing images and performing a search for an event by means a time- 
and/or position- and/or event index. 

In one embodiment, the positioning unit comprises: a transmitter/receiver 
located on a known position adjacent the object to be inspected, a receiver/transmitter 
located on the inspector, whereby the transmitter/receiver sends out a coded sound 
signal and the receiver/transmitter responds with a coded signal, which is received by 
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the transmitter/receiver and the position of the receiver/transmitter is decided with 
assistance of time and direction. Other positioning systems are known from ,e.g., U.S. 
4,981,353 and JP 81-36240. 

In another embodiment, the positioning unit comprises: a number of probes 
5 located at known positions, a transmitter located on the inspector, whereby the 

transmitter sends out a sound signal and the probes receive the signals and decide the 
position of the transmitter with assistance of a time difference between the probes and 
known positions are received either by placing the probes on the object or connecting 
the probes to a positioning system and connecting the object to the positioning system. 
10 In yet another embodiment, the positioning unit comprises: a digital compass 

module containing a number of magnetic axes and tilting sensors as well, compensating 
for the inclination of the magnetic axes and that the compass module keeping track on 
its position. 

In an alternative embodiment, the positioning unit comprises: an inertia gyro 
15 sensing the direction and speed and keeping track of the position by counting from a 
given start position. 

Preferably, said inspector is a diver or a robot. 

The system also includes a database arranged to store the incoming data, 
comprising a model of the ship, the image taken by the image recording unit, a position 

20 of the positioning system, sound of a sound recording unit and remarks provided with 
time index as well. The input signals of the database comprises amongst others: one or 
several drawings of the object, which are re processed to a model of the ship, a sound 
signal of one or several channels being converted to a standard format and provided 
with time index, video signal being converted to a standard format and provided with a 

25 time index and is eventually compressed, position being converted to a relative position 
and is provided with a time index, and remarks, which via a user interface is introduced, 
is provided with time index and stored. 
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The invention also refers to a method of inspection of an object by means of a 
system comprising at least an image recording means carried by an inspector, a display 
unit and a storing unit. The method comprising providing a contact free positioning 
unit and a device of the storing unit for at least storing an image recorded of said image 
5 recording unit in relation to a position given of said positioning unit and/or a time index. 

Moreover, the method comprises the step of connecting a time- and/or position 
index with said position and image and a note. 

Particularly, the invention relates to a method of inspecting a floating object in a 
medium, particularly a ship, by means of a system comprising at least an image 

10 recording unit carried by an inspector, and a computer unit communicating with a 

storage unit. The method comprises providing a contact free positioning unit at least at 
the object, and an arrangement of the storage unit for at least storing an image taken of 
said image recording unit in relation to a position given of said positioning unit and/or a 
time index. The inspection starts with a digital drawing of the object stored in the 

1 5 computer or a storage unit. The image recording unit and a signal of the positioning 

unit is connected to the computer. The position of the inspector is shown as a dot on the 
computer stored drawing. According to a preferred embodiment, the position of the 
inspector together with an image of the image recording unit is shown substantially 
continuously while the inspector moves from one position to a second position. In one 

20 embodiment, continuous registration of the position of the inspector is carried out. 
Preferably, at the appearance of a remark being stored and connected with an image, 
captions and at least a part of the drawing is connected with the position of the drawing. 
At the study of the inspection data including notes is recovered by pointing at a drawing 
corresponding said drawing by means of an indicator in a registered movement pattern 

25 of the inspector. 



RAK/elb 4050-68201 03/25/04 EXPRESS MAIL LABEL NO. EV331581839US 

DATE OF DEPOSIT: March 25, 2004 

-6- 

Short Description of the Drawings 

In the following, the invention will be described with reference to the 
embodiments shown at enclosed drawings, in which: 

Fig. 1 schematically shows a first embodiment of a system according to the 
present invention, 

Fig. 2 shows a comprehensive block diagram of the system according to the 
invention, 

Fig. 3 shows a comprehensive block diagram of the storage part in the computer 
system according to the invention, 

Fig. 4 shows a screen layout in the system according to the invention, 
Fig. 5 schematically shows a second embodiment of a system according to the 
present invention, and 

Figs. 6-13 illustrate other applications and features of the invention. 

1 5 Description of the Embodiments 

In the following, the invention is described with reference to a first embodiment 
relating to a system being used to inspect ships. However, the invention can be used to 
inspect and examine different objects. 

A system for inspection of, e.g., a ship 10 (or another floating object or 
20 immersed in a volume) according to the invention is shown in Fig. 1 preferably 

comprises a sound and image recording unit 30 of a diver 20, a positioning unit 40 and a 
computer unit 50. 

The diver 20 carries conventional diving equipment provided with a 
communication means and a camera 30 located, for example, on the helmet for 
25 recording images and sound, for facilitating the inspection work. 

The camera 30 can be a conventional submarine camera supplying analog and/or 
digital images and sound as well. However, the sound recording can be carried out by 
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means of separate equipment. The communication between the diver and the inspection 
ship 60 can be performed via cables 70 and/or wireless means via radio. 

The positioning unit can consist of any positioning system. Preferably, one or 
more of the following systems can be used. However, other equipment appropriate for 
5 the invention can also be present. 

The positioning system can comprise: 

Ultra short baseline (USBL); a transmitter/receiver is placed on a known 

position. A transfer is placed on the diver or the ROV. The transmitter/receiver sends a 

coded sound signal. The transponder responds with a coded signal. The 
10 transmitter/receiver receives the signal and decides the position of the transponder with 

assistance of the time and direction. 

Long Base Line (LBL): a number of probes are placed on known positions. A 

transmitter is located on the diver or the ROV. The transmitter sends a sound signal; 

the four probes receive the signal and decide the position of the transmitter with 
1 5 assistance from the time difference between the probes. The known positions are 

received either by placing the probes against, e.g., the ship or connecting these with the 

GPS system and connecting the ship with the GPS system. 

Digital Compass module: the system comprises a digital compass module 

containing three magnetic axes and two tilting sensors. The tilting sensors compensate 
20 for the inclination of the magnetic axes. The compass module keeps track of its 

position. A digital compass module can be used, e.g., on a ROV if it is completed with 

a speedometer. By the fact that the direction and the speed of the ship is known, the 

position can be calculated. The module must be provided with a start position. 

However, a magnetic compass module is not considered as appropriate when, e.g., a 
25 ship can interfere the magnetic field. 

Inertia gyro can be used in several military applications. The gyros sense the 

acceleration from which you can derive the direction and the speed, and keeping track 

of the position by calculating from a given start position. 
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Fig. 2 shows a block diagram of the computer unit 50. A video (camera), sound 
recording unit, positioning system signal, drawing basis from a drawing data base and 
eventually another communications means, such as a network communication, are 
directly or indirectly connected to the computer unit. Data processed in the data unit is 
5 transferred as a report to a storage unit, via for example a network connected to an 
intranet or the Internet. The system also gives an opportunity for performing the 
inspection at a distance, i.e., representatives of the diving company, the classification 
society or the shipping company do not need to be present on the accompanying boat, 
but can follow the inspection via the Web. 

10 The database 80, being schematically shown in Fig. 3, is arranged to store the 

incoming data, preferably processed data. In the database a model of the ship is stored, 
the film recorded by the camera of the diver, the position of the positioning system, the 
sound of the sound recording unit and remarks are provided with time index before they 
are stored. Consequently, the input signals of the database comprise: 

1 5 - one or several drawings over the ship, which are re-processed to a model 

of the ship, 

sound from one or several channels, which are converted to a standard 
format and provided with time- and/or position index by means of, e.g., a 
driving routine, 

20 - video signal of one or several channels being converted to a standard 

format and provided with time- and/or position index, and are eventually 
compressed, by means of, e.g., a driving routine, 
position being converted to a relative position and provided with time- 
and/or position index by means of, e.g., a driving routine, and 

25 - remarks, e.g., compensation remarks, being introduced via a users 

interface and provided with time/or position index and is stored. 
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A report can be put together from the database and data can be stored in an 
external medium, preferably in digital form, such as DVD, a detachable hard disc, DAT 
or the like. 

Fig. 4 shows a screen layout of the inspection. The layout comprises a number 
of fields: 

in a main field 100 a drawing of the ship is shown, both a side-view and 

a view from above (other views are also possible), 

in a second field 200 the images of the camera are shown, and 

in a third field 300 the remarks are shown in form of text. 

By the fact that a digital storing is used the damages can be associated with the 
images and a quick search and processing are provided. 

In the main field 100, further information is present. In a lower field 110, key to 
the signs are shown concerning the ship being inspected and time/date for the start of 
the inspection as well. 

The model of the ship 120 and 130, shown in the main field, is provided with a 
trace 121/131 showing the distance run or path of the diver, the position of the diver 
212/132 and the position for possible remarks. By using two views, a "three- 
dimensional" position is obtained with respect to the ship. The main field may also 
comprise a toolbar 140 for zooming in or out, displacement of views, copying, etc. 

Except for the viewing screen, the image and video field 200 also comprise 
means 210 for controlling the image, such as playback, storing, winding and the like. 
The time is also stated in a field 220. 

The remark field 300 is really a notepad wherein it is possible to introduce 
information, e.g., via the keyboard, which is connected together with the shown image 
and the position of the diver via time index. 

The function of the system is described in the following non-limited example: 
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The inspection work starts with a digital drawing of the ship 10 being stored in the 
computer 50 (new ships have digital drawings, the drawings are scanned for older 
ships). The computer replaces the TV-screen in a conventional inspection. 

The video camera 30 and a signal of the positioning system 40 are connected to 
5 the computer. The position of the diver is shown as a dot on the drawing being data 
stored. 

The people following the inspection from the accompanying ship 60 (Fig. 1) see 
the position of the diver together with the video film (field 200, Fig. 4) all the time, 
while the diver swims from one side to another side. Observers have the ability to 

10 verify any place where the diver films, making it easier to help the diver find particular 
locations on the ship and verify that the diver has been everywhere. 

A still picture is stored and connected together with all remarks, captions and a 
drawing having the position of the damage. This information is immediately printed 
after the inspection has concluded. The total work is stored on a storing media, such as 

15 a DVD disc. Consequently, report writing is simplified for each inspection. 

When studying inspection data, one only needs to click, by means of a mouse or 
the like, on the part of line 124/134 representing the position for which data is desired. 
This is preferable to prior systems which require reviewing the video until the correct 
position on the ship is found. The video for a single inspection is about eight hours. 

20 Of course, the diver can be replaced with a robot 20 ! and so-called ROV 

containing an image-/sound recording unit 30 f such as illustrated in Fig. 5. In this case, 
a means is arranged for controlling the robot from the inspection ship. 

As mentioned above, the ROV can be used in other fields. One application is 
illustrated in Fig. 6. In this case, an ROV 620 is provided with three cameras 630a- 

25 630c on a holders extending from the ROV. The ROV is used for inspecting a 

submerged pipe, such as an oil pipe in the seabed. The cameras are arranged in such 
way that they can record images from top, left and right sides of the pipe. The ROV is 
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controlled from an inspection boat (not shown) and transmits images to the inspection 
boat for recording. 

Fig. 7 is an example of an inspection display picture at the inspection boat. The 
picture comprises a map 750 and images 751a-751c from the three cameras. In the 
5 same way as the earlier embodiment, the defects or other events of interest are recorded 
with a notation associated to the position/time/event. 

The invention may also be used for inspection of pipes from inside, e.g., by 
means of a robot travailing inside the pipe, and storing or sending information to an 
inspection unit. 

10 Yet another application is illustrated in Fig. 8. In this case a vehicle 820 is 

provided with a camera 830 on the roof of the vehicle. The vehicle is used for 
inspecting roads or the surroundings. The position of the vehicle is provided with a 
positioning system such as GPS (GPS antenna 840). An inspector, e.g., in the vehicle 
receives images from the camera. 

15 Fig. 9 is an example of an inspection display picture in the vehicle. The picture 

comprises a map 950 and a video image 95 1 from the camera. The map is connected to 
the positioning system recording the position of the vehicle. In the same way as the 
earlier embodiment, events of interest are recorded with a notation associated to the 
position/time/event. 

20 Yet another application is illustrated in Fig. 10. In this case a helicopter 1020 

(or airplane) is provided with a camera 1030 under the cockpit. The helicopter is used 
for inspecting roads, power lines, bridges, forest etc. The position of the helicopter is 
provided with a positioning system such as GPS (GPS antenna 1040). An inspector, 
e.g., in the helicopter receives images from the camera. The helicopter is given as an 

25 example and any other flying craft can be used. 

Fig. 1 1 is an example of an inspection display picture in the helicopter or a 
remote location. The picture comprises a map 1 1 50 and a video image 1151 from the 
camera. The map is connected to the positioning system recording the position of the 
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helicopter. In the same way as the earlier embodiment, events of interest are recorded 

with a notation associated to the position/time/event. 

In the embodiment of Fig. 12, a person 1220 uses a camera 1230 for inspection 

and/or recording. The person can record or inspect roads, streets, etc. The position of 
5 the person is provided with a positioning system such as GPS (GPS positioning device 

1240). The camera may be connected to or comprise a computer unit. The person 

leaves notes, e.g., orally. 

Fig. 13 is an example of an inspection display picture in the computer. The 

picture comprises a map 1350 and a video image 1351 from the camera. The map is 
10 connected to the positioning system recording the position of the person, e.g., on a street 

map. In the same way as the earlier embodiment, events of interest are recorded with a 

notation associated to the position/time/event. Tourists visiting a city, etc., may also 

use this application. In this case, a tourist can use the system to record a tour and also 

add comments, e.g., orally, to the recorded tour. 
1 5 While we have illustrated and described preferred embodiments of the 

invention, it is realized that several variations and modifications are possible within the 

scope of the accompanying patent claims. 



